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METHOD, SYSTEM, AND ARTICLE OF MANUFACTURE FOR COPYING OF 
DATA IN A REMOTE STORAGE UNIT 

5 BACKGROUND 
1. Field 

[0001] The disclosure relates to a method, system, and article of manufacture for copying 
of data in a remote storage unit. 

10 2. Background 

[0002] Information technology systems, including storage systems, may need protection 
from site disasters or outages, where outages may be planned or unplanned. Furthermore, 
information technology systems may require features for data migration, data backup, or 
data duplication. Implementations for disaster or outage recovery, data migration, data 

1 5 backup, and data duplication may include mirroring or copying of data in storage 
systems. Such mirroring or copying of data may involve interactions among hosts, 
storage systems and connecting networking components of the information technology 
system. 

[0003] An enterprise storage server (ESS), such as the IBM* TotalStorage Enterprise 
20 Storage Server*, may be a disk storage server that includes one or more processors 

coupled to storage devices, including high capacity scalable storage devices, Redundant 
Array of Independent Disks (RAID), etc. The enterprise storage servers are connected to 
a network and include features for copying data in storage systems. 
[0004] Enterprise storage servers may include copy functions for copying data either 
25 locally, i.e., within the same on-site ESS, or remotely, i.e., copying data to a separate 
remote-site ESS. The copy functions can be classified as either dynamic or point-in-time 
copy functions. Dynamic copy functions constantly update the secondary copy as 
applications make changes to the primary data source. Point-in-time copying techniques 
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provide an instantaneous copy or view of what the original data looked like at a specific 
point in time. 

[00051 In certain enterprise storage servers there may be copy functions, such as, 
FlashCopy*, that provide a point-in-time copy of the data. Implementations may copy 
5 data between a set of local/source volumes and a corresponding set of remote/target 
volumes in enterprise storage servers. FlashCopy may provide a point-in-time copy for 
ESS volumes by creating a physical point-in-time copy of the data, with minimal 
interruption to applications, and make it possible to access both the source and target 
copies substantially immediately. Both the source and the target volumes reside on the 
10 same ESS system, although implementations may be possible where the source and target 
volumes reside on different ESS systems. 

[0006] Peer-to-Peer Remote Copy (PPRC) is an ESS function that allows the shadowing 
of application system data from a first site to a second site. The first site may be referred 
to as an application site, a local site, or a primary site. The second site may be referred to 

1 5 a recovery site, a remote site, or a secondary site. The logical volumes that hold the data 
in the ESS at the local site are called local volumes, and the corresponding logical 
volumes that hold the mirrored data at the remote site are called remote volumes. High 
speed links may connect the local and remote ESS systems. 
[0007] In the synchronous type of operation for PPRC, i.e., synchronous PPRC, the 

20 updates done to the local volumes at the local site are synchronously shadowed onto the 
remote volumes at the remote site. As synchronous PPRC is a synchronous copying 
solution, write updates are ensured on both copies (local and remote) before the write is 
considered to be completed for the application. In synchronous PPRC the application 
does not get the "write complete" condition until the update is synchronously done in 

25 both the local and the remove volumes. Therefore, from the application perspective the 
data at the remote volumes at the remote site is real time data always consistent with the 
data at the local volumes. 
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SUMMARY OF THE DESCRIBED EMBODIMENTS 
[0008] Provided are a method, system, and article of manufacture for copying data. A 
request is received at a first storage control unit having a first set of volumes, wherein the 
first storage unit is coupled via a link to a second storage control unit having a second set 
5 of volumes that are peer-to-peer copies of the first set of volumes, and wherein the 
request is for generating a copy of the first and second set of volumes in a third set of 
volumes in the second storage control unit. A command is transmitted via the link, from 
the first storage control unit to the second storage control unit, wherein the transmitted 
command is capable of causing the second storage control unit to generate the copy of the 
10 first and second set of volumes in the third set of volumes in the second storage control 
unit. 

[00091 In certain additional embodiments, the second set of volumes are copied to the 
third set of volume in the second storage control unit, wherein the copy is consistent at a 
point in time. In certain additional embodiments, copying the second set of volumes to 

1 5 the third set of volumes is performed by a point-in-time copy operation. 

[0010] In further embodiments, the second storage control unit does not have an active 
link for receiving commands from a device other than the first storage control unit. In yet 
additional embodiments, synchronous peer-to-peer copies of the first set of volumes are 
generated to the second set of volumes. 

20 [0011] In yet additional embodiments, the request is a FlashCopy command including an 
indicator that indicates that a FlashCopy operation is to be performed remotely from the 
first storage control unit, and wherein the FlashCopy command is received from a host 
coupled to the first storage control unit. The host is signaled that the copy has been 
generated. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0012J Referring now to the drawings in which like reference numbers represent 
corresponding parts throughout: 
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FIG. 1 illustrates a computing environment, in accordance with certain 
embodiments; 

FIG. 2 illustrates how logical volumes are copied, in accordance with certain 
embodiments; 

5 FIG. 3 illustrates how a FlashCopy command is transmitted from a host to first 

storage control unit for performing FlashCopy operations in a second storage control 
unit, in accordance with certain embodiments; 

FIG. 4 illustrates logic for consistent copying of data, in accordance with certain 
embodiments; and 

10 FIG. 5 illustrates a computing architecture in which certain embodiments are 

implemented. 

DETAILED DESCRIPTION 
[0013] In the following description, reference is made to the accompanying drawings 

1 5 which form a part hereof and which illustrate several embodiments. It is understood that 
other embodiments may be utilized and structural and operational changes may be made. 
[0014] FIG. 1 illustrates a computing environment utilizing two storage control units, 
such as, a first storage control unit 100 and a second storage control unit 102, connected 
by a data interface channel 104, such as, the Enterprise System Connection (ESCON)* 

20 channel or any other data interface mechanism known in the art (e.g., fibre channel, 

Storage Area Network (SAN) interconnections, etc.). The data interface channel 104 may 
form a peer-to-peer link that allows transfer of data between the first storage control unit 
100 and the second storage control unit 102. 

[0015] The two storage control units 100, 102 may be at two different sites that are 
25 within a synchronous communication distance of each other. The synchronous 

communication distance between two storage control units is the distance up to which 
synchronous communication is feasible between the two storage control units. Data may 
be synchronously copied from the first storage control unit 100 to the second storage 
control unit 102 via the data interface channel 104, i.e. a peer-to-peer copy relationship 
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may exist between the first storage control unit 100 and the second storage control unit 
102. In certain alternative embodiments, there may be more than two storage control 
units and mechanisms different from synchronous peer-to-peer copy may be used to copy 
data from the first storage control unit 100 to the second storage control unit 102. 
5 Furthermore, functions of a plurality of storage control units may be integrated into a 
single storage control unit, e.g., functions of the first storage control unit 100 and the 
second storage control unit 102 may be integrated into a single storage control unit. 
[0016] The first storage control unit 100 is coupled to a host 106 via a data interface 
channel 108. While only a single host 106 is shown coupled to the first storage control 

10 unit 100, in certain embodiments, a plurality of hosts may be coupled to the first storage 
control unit 100. The host 106 may be any computational device known in the art, such 
as a personal computer, a workstation, a server, a mainframe, a hand held computer, a 
palm top computer, a telephony device, network appliance, etc. The host 106 may include 
any operating system (not shown) known in the art, such as the IBM OS/390* operating 

15 system. The host 106 may include at least one host application 1 10 that sends 

Input/Output (I/O) requests and other commands to the first storage control unit 100 over 
the data interface channel 108. 

[0017] Unlike the first storage control unit 100 that is coupled to the host 106, the second 
storage control unit 102 is not coupled to any host. In certain embodiments, the second 

20 storage control unit 102 does not have system attachments to any computational device. 
Therefore, the resources and cost associated with data interface channels beyond the data 
interface channel 104 is absent for the second storage control unit 102. 
[0018] The storage control units 100, 102 may comprise logical volumes, where a logical 
volume may correspond to a physical storage volume. The physical storage volumes (not 

25 shown) may be configured as a Direct Access Storage Device (DASD), one or more 

RAID ranks, Just a bunch of disks (JBOD), or any other data repository system known in 
the art. For example, in certain embodiments the first storage control unit 100 may 
comprise logical volumes 1 12a. . . 1 12n, and the second storage control unit may comprise 
logical volumes 114a...ll4n, 116a...ll6n. 
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[0019] Therefore, FIG. 1, illustrates a computing environment where an application 1 10 
sends a command to a first storage control unit 100 over the data interface channel 108. . 
The first storage control unit 100 synchronously copies data from the first storage control 
unit 100 to the second storage control unit 102 in via a peer-to-peer mechanism over the 
5 data interface channel 104. On receipt of the command from the application, the first 
storage control unit 100 may direct the second storage control unit 102 to perform a 
FlashCopy in the second storage control unit 1 02. 

[0020] FIG. 2 illustrates how logical volumes are copied from the first storage control 
unit 100 to the second storage control unit 102 and within the second storage control unit 

10 1 02, in accordance with certain embodiments. 

[0021] In certain embodiments, data in the logical volumes 1 12a. . . 1 12n in the first 
storage control unit 100 are copied via synchronous peer-to-peer copy operations 200 to 
the logical volumes 1 14a. . . 1 14n in the second storage control unit 102. For example, 
data in the logical volume 1 12a in the first storage control unit 100 is synchronously 

15 copied to the corresponding logical volume 1 14a in the second storage control unit 102, 
data in the logical volume 1 12b in the first storage control unit 100 is synchronously 
copied to the corresponding logical volume 1 14b in the second storage control unit 102, 
and data in the logical volume 1 12n in the first storage control unit 100 is synchronously 
copied to the corresponding logical volume 1 14n in the second storage control unit 102. 

20 The synchronous copying of the logical volumes 1 12a. . . 1 12n to the logical volumes 

1 14a. . . 1 14n may be performed via a variety of techniques, including synchronous PPRC. 
[0022] In certain embodiments, data in the logical volumes 1 14a. . . 1 14n in the second 
storage control unit 102 are copied via FlashCopy operations 202 to the logical volumes 
1 16a... 1 16n in the second storage control unit 102. For example, data in the logical 

25 volume 1 14a in the second storage control unit 102 is copied via a FlashCopy operation 
to the corresponding logical volume 1 16a in the second storage control unit 102, data in 
the logical volume 1 14b in the second storage control unit 102 is copied via a FlashCopy 
operation to the corresponding logical volume 1 16b in the second storage control unit 
102, and data in the logical volume 1 14n in the second storage control unit 102 is copied 
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via a FlashCopy operation to the corresponding logical volume 1 16n in the second 
storage control unit 102. At the conclusion of the FlashCopy operations 202 data in the 
logical volumes 1 16a.. . 1 16n are consistent at a point in time with data in the logical 
volumes 1 12a. . . 1 12n and logical volumes 1 14a. . . 1 14n. Although, the embodiments use 
5 FlashCopy operations 202, other types of copy operations besides FlashCopy may also be 
used. Certain embodiments do not require the creation of a consistent copy of data. 
Additionally, in certain embodiments, consistency may be achieved by using the 
"Freeze" option of FlashCopy. 

[0023] Therefore, FIG. 2 illustrates how data is copied from the first storage control unit 
10 1 00 to the second storage control unit via synchronous PPRC and how a second copy is 
made of the copied data in the second storage control unit via FlashCopy, such that, the 
data in the first and second storage control units 100, 102 are consistent at a point in time 
at the conclusion of the FlashCopy operations 202. In certain embodiments, the 
synchronous peer-to-peer copy operations 200 may comprise a single or a plurality of 
1 5 operations, and the FlashCopy operations 202 may comprise a single or a plurality of 
operations. 

[0024] FIG. 3 illustrates how a FlashCopy command 300 is transmitted from the host 106 
to the first storage control unit 100 for performing FlashCopy operations 202 in the 
second storage control unit 102, in accordance with certain embodiments. 

20 [0025] In certain embodiments, the host 106 may send at least one FlashCopy command 
300 to the first storage control unit 100. The FlashCopy command 300 may include a 
remote flag 302, where the remote flag 302 is an indicator that indicates whether the 
FlashCopy command is to be executed remotely from the first storage control unit 100. 
For example, in certain embodiments if the remote flag 302 is "ON" then the FlashCopy 

25 command 300 may not be executed locally in the first storage control unit 100 but is 
forwarded by the first storage control unit 100 to a remote storage control unit, such as, 
the second storage control unit 102, for execution. In certain embodiments, the 
FlashCopy command 300 may be generated by the application 110 that runs in the host 
106. A user or an application that has a need to create a copy of the logical volumes 
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1 14a. . . 1 14n in the second storage control unit 102 may generate the FlashCopy 
command 300 to the first storage control unit 100. As the second storage control unit 102 
does not have system attachments that allow a host to directly communicate with the 
second storage control unit 102, the embodiments allow the host 106 to communicate 
5 with the second storage control unit 102 via the first storage control unit 100 and the data 
interface channel 104. 

[0026] On receiving the FlashCopy command 300 with the remote flag 302 being "ON" 
the first storage control unit 100 sends FlashCopy operations 202 to the second storage 
control unit 202. The FlashCopy operations 202 perform a FlashCopy of peers of logical 
10 volumes 1 12a. . . 1 12n, i.e., logical volumes 1 14a. . . 1 14n, to the logical volumes 

1 16a. 1 16b. At the conclusion of the FlashCopy operations 202, the logical volumes 
1 1 6a. . . 1 1 6n are consistent at a point in time with the logical volumes 1 1 2a. . . 1 1 2n and 
114a...ll4n. 

[0027J Therefore, FIG. 3 illustrates how point-in-time copies are made in the second 
1 5 storage control unit 102 that has no additional system attachments except for the data 
interface channel 104 to the first storage control unit 100. 

[0028] FIG. 4 illustrates logic for consistent copying of data implemented via the storage 

control units 100, 102, in accordance with certain embodiments. 

[0029] Control starts at block 400, where the logical volumes 1 12a. . . 1 12n in the first 

20 storage control unit 100 receive the FlashCopy command 300 with the remote flag 302. 
The first storage control unit 402 determines (at block 402) if the remote flag 302 is 
"ON". In certain embodiments the logic of receiving the FlashCopy command 300 (at 
block 400) and the determination (at block 402) of whether the remote flag 302 is "ON" 
and certain subsequent operations may be performed by an application implemented in 

25 the first storage control unit 100, or via hardware or firmware in the first storage control 
unit 100. 

[0030] If the first storage control unit 402 determines that the remote flag 302 is "ON", 
i.e., the FlashCopy command 300 is to be executed at a remote storage control unit, then 
the first storage control unit 100 transmits (at block 404) the FlashCopy operations 202 to 
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the second storage control unit 102 that is located remotely from the first storage control 
unit 100. The transmission over the FlashCopy operations 202 takes place over the data 
interface channel 104 that couples the first storage control unit 100 to the second storage 
control unit 102. In certain embodiments, the transmitted FlashCopy operations 202 can 
5 cause a FlashCopy of the logical volumes 1 14a...l 14n in the second storage control unit 
102 to the logical volumes 1 16a...l 16n in the second storage control unit 102, such that 
the logical volumes 1 16a...l 16n are consistent with logical volumes 1 12a...l 12n, 
1 14a...l 14n at a point in time. 

[0031] The first storage control unit 100 determines (at block 406) whether the remote 

1 0 FlashCopy operations 202 have completed. Prior to determining at the first storage unit 
100 whether the remote FlashCopy operations 202 have completed, the first storage 
control unit 100 may receive corresponding completion signals from the second storage 
control unit 102, where the completion signals from the second storage control unit 102 
may indicate the completion of the FlashCopy operations 202 at the second storage 

15 control unit 102. 

[0032] If the first storage control unit 100 determines (at block 406) that the remote 
FlashCopy operations 202 have completed, then the first storage control unit signals (at 
block 406) the completion of the FlashCopy operations 202 to the host 106 and the 
control stops (at block 410). 

20 [0033] If the first storage control unit 100 determines (at block 406) that the remote 
FlashCopy operations 202 are incomplete, then the first storage control unit 100 again 
determines (at block 406) whether the remote FlashCopy operations 202 have completed. 
[0034] If the first storage control unit 402 determines (at block 402) that the remote flag 
302 is not "ON", i.e., the FlashCopy command 300 is not to be executed at a remote 

25 storage control unit, then the first storage control unit 100 may perform (at block 412) 
other operations locally at the first storage control unit 100 based on the FlashCopy 
command 300 and the control stops (at block 410). 

[0035] Therefore, FIG. 4 illustrates certain embodiments in which the first storage 
control unit 100 communicates commands for performing FlashCopy operations to a 
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second storage control unit 102 that is in a peer-to-peer copy relationship with the first 
storage control unit 100. The commands are communicated from the first storage control 
unit 100 over the already existing data interface channel 104 that couples the first 
storage control unit 100 to the second storage control unit 102. 
5 [0036] Certain embodiments allow customers and users, who have the need to 

communicate with the logical volumes 1 14a. . . 1 14n in the second storage control unit 
102, the ability to create a safety copy of the logical volumes 1 14a. . . 1 14n in the logical 
volumes 1 1 6a. . . 1 1 6n. The safety copy of the logical volumes 1 1 6a. . . 1 1 6n are consistent 
at a point-in-time with the logical volumes 1 12a. . . 1 12n, 1 14a. . . 1 14n. The second storage 

10 control unit 102 does not require an active host system connection and receives the 
commands for generating the safety copy over an existing link with the first storage 
control unit 100. In many situations, customers and users may bear additional expenses 
for extra communication links. Therefore, potential resources and potential costs 
associated with system attachments beyond the data interface channel 104 are saved. 

1 5 Furthermore, there is no need for extra operating system licenses because no hosts are 
directly attached to the second storage control unit 102. 

[0037] Additionally, in certain embodiments, such as system 390 based embodiments 
where the host 106 runs the OS/390 operating system, there may be a limit on the number 
of volume addresses that can be addressed by the host 106. If the host 106 were 

20 configured to connect directly to both the first storage control unit 100 and the second 
storage control unit 102 then the host 106 would have to address both the logical volumes 
1 12a. . . 1 12n and the logical volumes 1 14a. . . 1 14n. In certain embodiments, since the host 
106 is coupled to only one storage control unit the number of logical volumes addressed 
by the host 106 is potentially halved. As a result, the limited number of volume addresses 

25 may be used more effectively by the host 106. 

[00381 Furthermore, the embodiments allow the logical volumes 1 16a. . . 1 16n to be 
consistent at a point-in-time with the logical volumes 1 12a. . . 1 12n, 1 14a. . . 1 14n. 
Therefore, users and customers may use the logical volumes 1 16a. . . 1 16n for performing 
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various operations, with the guarantee that the logical volumes 1 16a. 1 16n are 
consistent at a point-in-time with the logical volumes 1 12a. . . 1 12n, 1 14a. . . 1 14n. 

Additional Embodiment Details 
5 [0039] The described techniques may be implemented as a method, apparatus or article 
of manufacture involving software, firmware, micro-code, hardware and/or any 
combination thereof. The term "article of manufacture" as used herein refers to program 
instructions, code and/or logic implemented in circuitry (e.g., an integrated circuit chip, 
Programmable Gate Array (PGA), ASIC, etc.) and/or a computer readable medium (e.g., 

10 magnetic storage medium, such as hard disk drive, floppy disk, tape), optical storage 

(e.g., CD-ROM, DVD-ROM, optical disk, etc.), volatile and non-volatile memory device 
(e.g., Electrically Erasable Programmable Read Only Memory (EEPROM), Read Only 
Memory (ROM), Programmable Read Only Memory (PROM), Random Access Memory 
(RAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory 

15 (SRAM), flash, firmware, programmable logic, etc.). Code in the computer readable 
medium may be accessed and executed by a machine, such as, a processor. In certain 
embodiments, the code in which embodiments are made may further be accessible 
through a transmission medium or from a file server via a network. In such cases, the 
article of manufacture in which the code is implemented may comprise a transmission 

20 medium, such as a network transmission line, wireless transmission media, signals 

propagating through space, radio waves, infrared signals, etc. Of course, those skilled in 
the art will recognize that many modifications may be made without departing from the 
scope of the embodiments, and that the article of manufacture may comprise any 
information bearing medium known in the art. For example, the article of manufacture 

25 comprises a storage medium having stored therein instructions that when executed by a 
machine results in operations being performed. 

[0040] FIG. 5 illustrates a block diagram of a computer architecture in which certain 
embodiments are implemented. FIG. 5 illustrates one embodiment of the host 106, and 
the first and second storage control units 100, 102. The host 106 and the storage control 
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units 100, 102 may implement a computer architecture 500 having a processor 502, a 
memory 504 (e.g., a volatile memory device), and storage 506. Not all elements of the 
computer architecture 500 may be found in the host 106 and the storage control units 
100, 102. The storage 506 may include a non- volatile memory device (e.g., EEPROM, 
5 ROM, PROM, RAM, DRAM, SRAM, flash, firmware, programmable logic, etc.), 

magnetic disk drive, optical disk drive, tape drive, etc. The storage 506 may comprise an 
internal storage device, an attached storage device and/or a network accessible storage 
device. Programs in the storage 506 may be loaded into the memory 504 and executed 
by the processor 502 in a manner known in the art. The architecture may further include a 
10 network card 508 to enable communication with a network. The architecture may also 
include at least one input device 510, such as a keyboard, a touchscreen, a pen, voice- 
activated input, etc., and at least one output device 512, such as a display device, a 
speaker, a printer, etc. 

[0041] At least certain of the operations of FIG. 4 may be performed in parallel as well as 
1 5 sequentially. In alternative embodiments, certain of the operations may be performed in a 
different order, modified or removed. 

[0042] Furthermore, many of the software and hardware components have been 
described in separate modules for purposes of illustration. Such components may be 
integrated into a fewer number of components or divided into a larger number of 
20 components. Additionally, certain operations described as performed by a specific 
component may be performed by other components. 

[0043] The data structures and components shown or referred to in FIGs. 1-5 are 
described as having specific types of information. In alternative embodiments, the data 
structures and components may be structured differently and have fewer, more or 
25 different fields or different functions than those shown or referred to in the figures. 

[0044] Therefore, the foregoing description of the embodiments has been presented for 
the purposes of illustration and description. It is not intended to be exhaustive or to limit 
the embodiments to the precise form disclosed. Many modifications and variations are 
possible in light of the above teaching. 

12 



Docket No. TUC920030044US1 
Firm No. 0022.0044 



♦IBM, IBM TotalStorage Enterprise Storage Server, Enterprise System Connection 
(ESCON), OS/390, Peer to Peer Remote Copy (PPRC), FlashCopy are trademarks of 
International Business Machines Corp. 
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